A note on the comparison of minimax linear and mixed regression estimation of regression coefficients when prior estimates are available

ثبت نشده
چکیده

When prior estimates of regression coe cients along with their stan dard errors or their variance covariance matrix are available they can be incorporated into the estimation procedure through minimax linear and mixed regression approaches It is demonstrated that the mixed regres sion approach provides more e cient estimators at least asymptotically in comparison to the minimax linear approach with respect to the criterion of variance covariance matrix keywords linear regression mixed model Introduction Recent studies past experience and pilot investigations often provide some use ful information in the form of estimates of coe cients in a linear regression model along with their standard errors or their variance covariance matrix Such a prior information can be incorporated into the estimation procedure in two simple ways based on point and interval estimation of parameters One is to express it as a set of stochastic linear restrictions and to apply the method of mixed regression estimation And the other is to form a con dence ellipsoid for the regression coe cients and to apply the method of minimax linear esti mation The latter approach generally does not lead to a simple form of the estimators and iterative procedures are to be followed see e g Schipp for an interesting exposition However if we take the matrix involved in the quadratic loss function to be of rank one the estimators have a closed form see e g Rao and Toutenburg Chap Here we restrict our attention to such estimators Superiority of estimators arising from both the mixed regression and mini max linear estimation procedures over the conventional estimators ignoring the prior information is well discussed in the literature but explicit attention does not seem to have been paid to the relative e ciency of one approach over the other see e g Rao and Toutenburg for the details This has formed the subject matter of this note Taking the performance criterion to be the variance covariance matrix it is found that the mixed regression approach provides more e cient estimators than the minimax linear approach at least asymptotically Main Result Consider a linear regression model y X u wehere y is a n vector of n observations on the study variable X is a n K matrix of n observations on K explanatory variables is a K vector of regression coe cients and u is a n vector of disturbances following a multivariate normal distribution with null mean vector as and variance covariance matrix as times an identity matrix It is assumed that the matrix X has full column rank and the scalar is unknown Further let us assume to be given the prior information specifying an unbi ased estimate b along with the variance covariance matrix s X X based on n observations from some extraneous source This prior information can be expressed in two forms for the purpose of utilizing it in the estimation of From the viewpoint of point estimation we may write it as

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Liu Estimates and Influence Analysis in Regression Models with Stochastic Linear Restrictions and AR (1) Errors

In the linear regression models with AR (1) error structure when collinearity exists, stochastic linear restrictions or modifications of biased estimators (including Liu estimators) can be used to reduce the estimated variance of the regression coefficients estimates. In this paper, the combination of the biased Liu estimator and stochastic linear restrictions estimator is considered to overcom...

متن کامل

Positive-Shrinkage and Pretest Estimation in Multiple Regression: A Monte Carlo Study with Applications

Consider a problem of predicting a response variable using a set of covariates in a linear regression model. If it is a priori known or suspected that a subset of the covariates do not significantly contribute to the overall fit of the model, a restricted model that excludes these covariates, may be sufficient. If, on the other hand, the subset provides useful information, shrinkage meth...

متن کامل

Some Modifications to Calculate Regression Coefficients in Multiple Linear Regression

In a multiple linear regression model, there are instances where one has to update the regression parameters. In such models as new data become available, by adding one row to the design matrix, the least-squares estimates for the parameters must be updated to reflect the impact of the new data. We will modify two existing methods of calculating regression coefficients in multiple linear regres...

متن کامل

Daily Pan Evaporation Estimation Using Artificial Neural Network-based Models

Accurate estimation of evaporation is important for design, planning and operation of water systems. In arid zones where water resources are scarce, the estimation of this loss becomes more interesting in the planning and management of irrigation practices. This paper investigates the ability of artificial neural networks (ANNs) technique to improve the accuracy of daily evaporation estimation....

متن کامل

On the Minimax Optimality of Block Thresholded Wavelets Estimators for ?-Mixing Process

We propose a wavelet based regression function estimator for the estimation of the regression function for a sequence of ?-missing random variables with a common one-dimensional probability density function. Some asymptotic properties of the proposed estimator based on block thresholding are investigated. It is found that the estimators achieve optimal minimax convergence rates over large class...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2007